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ABSTRACT 

The  aim  of  this  paper  is  to  derive,  the  exact  analytical  expression  for  estimation  of  Parameters  of  Pareto 
distribution,  using  entropy  loss  functions.  Our  purpose  is  to  obtain,  bias  estimator  and  the  associated  risk  function  of 
different  types  of  loss  function,  namely  SELF  absolute  loss  function,  Linex  loss  function,  Precautionary  Loss  function  and 
entropy  loss  function.  The  purpose  is  to  find  out  the  most  suitable  loss  function,  amongst  these  five  loss  functions.  In  this 
paper,  parameters  of  Pareto  distribution  have  been  estimated,  by  using  the  method  of  moments.  The  workability  of  the 
estimator  is  then  compared,  on  the  basis  of  their  risks  obtained  under  different  loss  functions.  The  relative  efficiency  of  the 
estimator  is  also  obtained.  In  the  end,  Monte-Carlo  simulation  has  been  performed,  to  compare  performances  of  the  bias 
estimates,  under  different  situations. 
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4.1.  INTRODUCTION 

Pareto  distribution  was  applied  by  Pareto,  to  model  the  allocation  of  wealth  among  individuals  and  the  distribution 
of  incomes.  It  has  been  widely  used  in  economics,  insurance,  geography,  clusters  of  a  Bose  Einstein  condensate  near 
absolute  zero,  physical  sciences,  chemical  sciences.  Asrabadi  (2015),  established  the  UMVUEs,  for  the  PDF  and 
cumulative  distribution  function  (CDF)  of  Pareto  distribution.  Asrabadi  et.  al  (2015),  further  studied  the  MSE  of  MLEs  and 
UMVUEs,  of  PDF  and  CDF. 

The  applications  of  entropy,  originated  in  the  nineteenth  century,  in  the  field  of  Statistical  Mechanics  and 
Thermodynamics.  In  this  chapter,  we  have  derived  analytical  expressions,  for  estimation  of  Parameters  of  Pareto 
distribution,  using  entropy  loss  function  and  also  have  obtained  bias  of  the  estimator  and  the  associated  risk  function,  for 
other  different  types  of  loss  functions,  namely  SELF,  Absolute  loss  function,  Linex  loss  function  and  Precautionary  Loss 
function.  The  objective  is  to  find  out  the  most  suitable  loss  function,  amongst  these  five  loss  functions.  In  this  chapter, 
parameters  of  Pareto  distribution  have  also  been  estimated.  In  this  chapter,  the  entropy  expression  for  Pareto  (II) 
distribution  is  derived.  The  workability  of  the  estimator  is  then  compared,  on  the  basis  of  their  risks,  obtained  under 
different  loss  functions.  These  distributions  have  important  roles,  as  parametric  models  in  reliability,  actuarial  science, 
economics,  finance  and  telecommunications.  Analytical  expressions,  for  the  entropy  of  bivariate  distributions  are 
discussed,  in  references  like  Hui  He  (2014),  G.H  Yari  (2010). 

The  random  variable  X  is  said  to  have  two  Parameter  Pareto  distributions,  if  its  density  function  is  given  by, 

=  ;  x  >p>  0,  a  >  0 


www.iaset.us 


editor@iaset.us 


Devya  Mahajan  &  Parmil  Kumar 


The  Shannon  measure  of  entropy  of  fx  (x)  is 

a 

Hsh(X)  =  - 1  /  ( x ) log/  (x)dx 


rap  ap 

=  -J^7Tlog^7r^ 

^  X  X 

=  -logxa+1]dx 

p  x 

=  ~]  ^rlo§  «Padx  +  J  (a  + 1)  log  x]Jx 

y?  ■*  y?  X 

a  a 

=  -af5a  log  a(3a  ^  x~a~1dx  +  a/3a  (a  +  1)  J  x~a~l  log  xdx  (l.l 

p  p 

As  an  equation  (4.1.1)  has  Integrals  with  improper  integral  limits,  we  introduce  ‘t’  to  solve  this  improper  integral 

a  t 

|  f(x)dx -  ltjf(x)dx 

P  a 

Then  equation  (1.1)  becomes:- 
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aj3a  (a  +  l)(-j3~a^ 


a  y  -a  ) 


=  -  log  a/3  +  a  log  [5  +  log  p  + 


a  + 1 


a 


=  -  log  a  -a  log  p  +  a  log  p  +  log  p  + 1  h — 

a 


a 


Thus,  it  can  be  seen  that,  the  entropy  is  a  function  of  both  the  parameters  a  as  well  as  p.  Further,  it  can  be  seen 
that,  smaller  the  value  of  a,  larger  will  be  entropy.  So,  it  is  true  about  dispersion. 

4.2.  ESTIMATION  OF  ENTROPY  OF  PARETO  DISTRIBUTION 

In  a  random  sample,  there  would  always  be  an  infinite  number  of  functions  of  sample  values,  called  statistics, 
which  may  be  proposed  as  estimates  of  one  or  more  of  the  parameters.  The  best  estimate  is  one  that  falls  nearest  to  the  true 
value  of  the  parameter  to  be  estimated.  The  estimating  functions  are  then  referred  to  as  estimators. 

In  estimation  theory,  we  are  concerned  with  the  properties  of  estimators  and  methods  of  estimation.  The  merits  of 
an  estimator  are  judged,  by  the  properties  of  the  distribution  of  estimates,  obtained  through  estimators. 

The  problem  of  estimating  of  entropy  reduces  to  problems  of  estimating  of  parameters  a  andf3.  Commonly  used 
methods  of  estimation  are:- 

•  Method  of  Maximum  Likelihood  Estimation 

•  Method  of  Minimum  Variance 

•  Method  of  Moments  (MOM) 

•  Method  of  Least  Squares 

•  Method  of  Minimum  Chi-  Square 

•  Method  of  Inverse  Probability 

As  it  involves  two  parameters,  both  cannot  be  estimated  together,  through  MLE.  So,  a  different  approach  and 
methods  adopted  can  be  discussed. 

Karmeshu  (2003),  gave  the  estimates  of  parameters,  using  MOM  as  x 


0  _  x[a-l) 


a 
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Where,  x  and  cv  are  mean  and  coefficient  of  variation,  defined  as 


a- 1 

o  1 


x  [a(o:-2)]0-5 

where  er2  =  — Hf-i (x;  —  x)2 

n-i  1-1 

and  n  is  the  number  of  observation. 

But,  as  simultaneous  estimation  is  not  possible.  So,  we  consider  three  cases 

i)  When  a  is  known,  (3  Unknown 

ii)  When  [3  is  known,  a  Unknown 

iii)  When  a  and  [3  both  are  unknown 


CASE  I 

Under  the  SELF,  the  problem  of  estimating  H  ( f3  )  is  equivalent  to  that  of  estimating  log  f3  when  a  is 

assumed  to  be  known,  that  is  a  =  ^0  (say) 

Let  5f  is  the  estimator  of  entropy  of  pareto  distribution.  Let  51=  logfi 

then  Of  =  S±  +  e  where  e  —  —  —  lnaQ  +  1 

“0 

Now,  we  will  estimate  the  log  P  using  SELF 
Estimation  of  log  (3  under  SELF  is  defined  as 

L(51,logP)  =  (51-logP)2 

Risk  function  of  an  estimator  d'j  of  log  (3  will  be  denoted  by 
And  R(51;  Q)=  Eq[L(81,  log[ ?)]  where  Q  =  (a,  P) 

But,  in  this  case  a  -a0  (Known)  is  assumed  to  be  known. 

Next,  we  find  the  Risk  function  and  a  bias  function  of  the  corresponding  estimator 

6,e  =  Si  -  lna0  +  —  +  1  (2.1) 

“0 

8,e  =  5,  +  e 

and  the  estimate  of  entropy  //(/?)  are  derived  as  below 
ReW.HW)  =EQ[L(81E,Hm]2 
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=  EQ[81E-Htf)]2 

=  Eq[81  +  e  —  [Inf]  +  c}]2  where  c  =  -  —  loga  +  1 
=  Eq[81  +  e  —  Inf  —  c]2 
=  EQ[S1-lnp]2 
=  £Q(L(<Mn/?)) 

Ignoring  the  constant  term  [a  =  a0],  we  get 

Re(sie,H(P))  =  R(81,Q)  (2.2) 

Be(81e,H(0))  =  ,H{f3)\ 

=Eq  [^  +  e  —  {Inf  +  c}] 

-Eq  [5j.  +  e  —  Inf  —  c] 

=£<2  [Si  -  Inp] 

Be(51e,H(P))  =  B(S1iQ )  (2.3) 

Next,  we  compute  the  risk  function  for  Absolute  Loss  function. 

Absoluteloss  function  is  given  by 

L(0,d)  =  c|d- Y(0)l 

Where,  again  c(0)  >  0  but  independent  of  0. 

For  Absolute  Loss  function,  the  Risk  function  is 

RE(81E,Hm)=EQ[L(81E,Hm\ 

Re(S1e,H(P))=Eq[\51e,H(P)\\ 

=  £q[|Si  +  e-  {Inf  +  c}|] 

=  £q[|Si  +  e  -  Infi  —  c\\ 

=  FQ[|51-(n/?|] 

=  FQ(L(d1,(n/?}) 

Re(81e,HU1))=R(S1,Q)  (2.4) 

Basu  and  Ebrahimi  (1991)  Considered  the  Linex  (Linear  exponential)  loss  function 
L( A)  =  b\eaA  —  aA  —  1], a  ^  b  >  0 

Where,  A=  ^  —  1  and  Q  is  the  estimator  of  Q. 
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Thus,  Linexloss  function  is  almost  symmetric  and  not  too  different  from  a  Squared  error  loss  function. 
For  Linex  Loss  function  the  risk  function  is 


RE(S1E,HW)=EQ[L(81E,Hm\ 

Re(8iE ,  H(f3))  =  Eq  | b  |eafSl  ~H^}  —  a{StE  —  //(/?)}  —  l}J,  wherea  is  a  constant,  a  ^  0 
=  EQ[b{ea{s  i+e-an/?+c}}  _  a{5i  +e_  ynp  +  c)j  _  yj] 

=  EQ[b{ea[si-lnP]  -  a{81  -  ln/3}  -  l}] 

=  EQ[L(6ltlnP)] 

Re(81e,H<J3))=R(81,Q)  (2.5) 


Precautionary  Loss  Function 


Norstrom  (1996),  introduced  an  alternative  asymmetric  precautionary  loss  function  and  also  presented  a  general 
class  of  precautionary  loss  functions,  with  quadratic  loss  function  as  a  special  case  (Srivastava,  et  al.  (2004)).  A  very  useful 
and  simple  asymmetric  precautionary  loss  function  is  given  as. 


L  (9,9)  = 


(g  6»)2 
8 


For  Precautionary  Loss  function,  we  find  Risk  function 

RE(81E,HW)=EQ[L(81E,Hm\ 


Re{81e,HU1))=Eq 


8i-H 


o?)}2 


n  \{81+e-anp+c)}2-\ 

M  ^  J 

r-  \{81+e-lnp-c}2-\ 

M — ^ — J 


r-  \{8i~lnP}2 
EQ 


+e 


] 


=  EQ[L(8i,lnp)\ 


RE{81E,H{p))  =  R(8X,Q)  (2.6) 

Entropy  Loss  Function 

Calabria  and  Pulcini  (1994),  proposed  another  alternative  to  the  modified  Linex  loss  function,  named  general 
entropy  loss  function  and  defined  it  as, 

ie(0»4)  =  (f)p -pln(|)  -  1;  P>0 

which  has  a  minimum  at  d  =  0.  This  loss  is  a  generalization  of  the  entropy  loss  function,  used  by  several  authors 
taking  the  shape  parameter  p—  1 . 
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For  Entropy  Loss  function,  the  risk  function  is 


Put  p=  1  the  risk  function  is  given  by 


[(il)- 

IW>/ 

In  ^ 

-  In 

(S1+C\  1 

YKlnP+cJ 

Klnfi  +  c)  ■‘‘J 

kx: 

l] 

CASE  II 


Under  the  SELF,  the  problem  of  estimating  H{cc)  is  equivalent  to  that  of  estimating  log  a  when  J3 
i.e./?  =  /?0  (say) 


For  an  estimator  52of  log  a  corresponding  estimator  of  entropy  H  (a),  is  given  by 

82E=i°gPo  —  logs 2  +  +  1 

°2 

S2e-  —logS2  +  logf!0  +  —  +  1 
°2 

E  1 

S2  -e1  —  logS2  +  —  where  e1  =  log/30  +  1 
°2 

S2e-  - logS2  +  e1  +  — 
q2 

Squared  Error  Loss  Function  (SELF) 

The  squared  error,  loss  function  is  defined  as 
L  (9,9)  =  (9- 0)2 

The  Bayes  estimator,  under  the  above  loss  function,  say  8  is  the  posterior  mean,  i.e.  0B  —  En(8). 
The  risk  function  is  given  by:- 
Rb(§)  =  Ee(0)2  —  20Ee(0)  +  02 
Now,  we  will  estimate  the  loga  using  SELF 
Estimation  of  log  a  under  SELF,  is  defined  as 
L(52,loga)  =  (S2  -  loga)2 


(2.7) 


is  known 
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Risk  function  of  an  estimator  52  °f  log  a,  will  be  denoted  by 

R(52,  Q)=  £Q[L(52,loga)],  where  Q  =  (a,  P),  but  in  this  case  /?  =  /?0  (known). 

Next,  we  find  the  Risk  function  and  a  bias  function  of  the  corresponding  estimator 
Re(S2e  ,//(«))  =  Eq[L(S2e  ,tf(a))f 
=  Eq[82e  -  H{a)}2 

—  Eq  |—  logS2  +  +  e1  —  —  loga  +  cjj  where  c  —  logfi  +  land  —  log[30  +  1 

=  Eq  |  —  logS2  +  y-  +  e1  +  loga  —  ^  —  c] 

Re(82e,  H (a))=  Eq  [-logS2  +  ^  +  e1  +  loga  -  i  -  c] 

Ignoring  the  constant  term 

Re(82e,  H(a))=  Eq  [-logS2  +j-+  loga  -  ^  (2.8) 

4.3.  SOME  RESULTS 

We  prove  some  important  results,  which  are  helpful  in  further  advancing  the  estimation  of  entropy. 

Theorem:  Sample  mean  is  consistent  estimator  of 8,  and  0(5)  is  a  continuous  function  of  8,  then,  0(x) is  a  consistent 
estimator  of  0(5). 

Proof:  — >Since  X  is  a  consistent  estimator  of  8, 

_  p  _ 

X  — ^  8  X  as  h  — >  °° 

For  every,  f>0,n>03a  positive  integer  n  >m(e,  n) 

P{|x  —  S|  <  e]  >  1  —  ?7  V  n  >  m  (3.1) 

Since,  0(. )  is  a  continuous  function,  for  every  e  >  0,  however  small,  3  a  positive  number  such  that, 

|0(x)  —  0(5)|  <  e1  whenever  \x  —  5|  <  e 

i.e\x  -  5|  <  e  =>  1 0(x)  -  0(5)|  <  £t  (3.2) 

For  two  events  A  and  B,  if  A=>B  then, 

A  £  B 

P(A)  <  P(B ) 

P(B)  >  P(A) 

From  equations  (4.3.1)  and  (4.3.2)  we  have, 


Impact  Factor  (JCC):  3.9876 


NAAS  Rating  3.45 


Estimation  of  Parameters  of  Pareto  Distribution  using  Different  Loss  Functions 


107 


p (I0O)  -  0(5)1  <  ej  >  P(\x  -  5|  <  e) 

P(\cf>(x)  —  0(5)1  <  ex)  >  1  —  77  V  n  >  m 
0(x)  ->  0(5),  as  n  -»  oo 
c p(x )  is  a  consistent  estimator. 

Theorem:  5f  is  an  unbiased  estimator  of  log  (3 . 

Proof:  When  (3  is  unknown  and  a  is  known,  that  \sC(=(X{)  say 

From  equation  (4.2.1),  we  have 

S1  —  Si  —  lna0  H - h  1 

“0 

5jE  =  5,  +  e 

Taking  the  expectation  on  both  sides,  we  get 
£'(51e)  =  £(5i  +  e) 

£■(5/)  =  £(50  +  e 
£(5iB)  =  log  (3  +  e 
£(5/)  =  log  (3 

4.4  GRAPHICAL  REPRESENTATION  FOR  ENTROPY  OF  PARETO  DISTRIBUTION  FOR  FIXED 
VALUE  OF  ALPHA  &  BETA 


Graph  1:  Graph  between  Entropy  and  Parameter  Alfa 
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Graph  2:  Graph  between  entropy  and  Parameter  Beta 

4.5.  CONCLUSIONS 

In  this  paper,  we  have  derived  the  entropy  of  the  Pareto  distribution,  for  two  parameters.  Also,  we  have  computed 
the  various  estimates  and  their  biases,  and  risk  functions  associated  with  different  loss  functions. 
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